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^Beiflnd 


By Edwin Wargo 

I f technology can affect student 
learning, shouldn’t it be considered 
in making decisions? Data-driven 
decision making models include data 
from curriculum, instruction, test 
scores, lunch programs, budgets, and 
transportation. None of the cur- 
rent models include anything about 
technology. iVe seen some of the best 
programs come to a halt when this in- 
formation wasn’t considered because 
of either a lack of data or because the 
decision maker didn’t find it impor- 
tant. I believe that true integration of 
technology will not occur until educa- 
tional technology data is considered. 

The challenge with any type of data- 
driven decision making process is 
threefold: collecting the information, 
finding what set of filters (questions) 
need to be created, and ensuring the 
filtered information is understandable 
and meaningful. 

Decisions are limited by the infor- 
mation used to make them. As the 
information becomes more complex 
and plentiful, it’s harder to discern 
which pieces to use and what each 
piece means. Take information about 
your school’s educational technology, 
for example. It can be both complex 
and plentiful, but it needn’t be difficult 
to use. 

Raw data is both complex and plen- 
tiful. The key to making it meaning- 
ful is filtering it specifically for the 
person viewing it. Questions need to 
be formed about which data is impor- 


tant. This is the essence of a process 
that takes raw data, filters it based on 
questions, and then provides answers 
in a meaningful format and under- 
standable language. The reported data 
(or answers) can be used for all school 
stakeholders to make decisions. Be- 
cause filtering is the bridge from the 
technical to the meaningful, we’ll be- 
gin with it. 

Ed Tech data can be filtered and 
ultimately made meaningful. Once the 
answers are provided, this data can 
be used like any other data to make 
decisions. The decisions include cur- 
riculum, instruction, learning, and 
assessment. 

Ed Tech Data Filtering 

Ed Tech data filtering is as simple as 
organizing information relating to 
educational technology. The data is fil- 
tered according to who is viewing the 
information, making it as meaningful 
as possible for them. Once filtered, the 
information can be translated into an 
understandable format and used to 
make decisions. 

Each of the filters is a question. The 
process is very similar to using an 
Internet search engine. Type in your 
question or a few keywords and a list- 
ing of Web sites containing the speci- 
fied information is displayed. Done 
correctly, and carefully, you’ll get just 
the results you are seeking. 

If the principal wants to know if the 
handheld computers are being used. 



he or she can find out what the per- 
centage or totals are for a given time 
period. If a curriculum coordinator 
wants to know what technology is be- 
ing integrated into lessons for the up- 
coming week or for a particular topic, 
by grade, school, or district, it can be 
displayed. 

Ed Tech data in more traditional 
formats is especially challenging be- 
cause most people view it as a foreign 
language and require the school’s 
technical person to assist them. Al- 
though the school’s technical person 
should be chief translator and gatherer 
of technical information, all school 
stakeholders can benefit from using 
this data themselves. 

Student learning is what we are 
all striving for in education, so 
creating a set of filters for each stake- 
holder to show how educational 
technology affects student learning 
makes the data meaningful. With 
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meaningful data, decisions can be 
made. 

Filtering is like the old adage, “Tell 
em what they need to know” with 
a few exceptions. First, telling them 
what they need to know is risky be- 
cause it may not answer their ques- 
tions or make sense. Done correctly, 
though, it can provide a good start- 
ing point. Second, what they need to 
know may not seem important at the 
time or out of context. The informa- 
tion should be presented in a clear and 
understandable manner. Third, there 
should be means for school stakehold- 
ers to also ask and not just be told. 

Filtering and reporting can also be 
viewed as a chicken and egg game. 
What comes first, the answer or the 
question? If a school stakeholder 
doesn’t know what questions to ask, 
how does the information get pre- 
sented? Information cant be just arbi- 
trarily presented. 


Ed Tech Data 

Ed Tech data can be broken into 
five areas. The total cost of the tools 
needed to gather the data for an aver- 
age size school district is only about 
$1,000. If the free version of Ilients 
SysAid Help Desk software is used, 
the price becomes even less. {Editor's 
note: For this and other URLs, see the 
Resources section on p. 25.) Also, all 
of the products mentioned offer evalu- 
ation and shareware versions that al- 
low you to test the software. 

Capacity. Capacity is what your 
technology is capable of providing. 
This information can be collected by 
a variety of inexpensive tools such 
as Paessler Router Traffic Grapher 
(PRTG) and CatTooIs. Capacity infor- 
mation tells you if the program you 
plan on offering is technically feasible. 
For example, videoconferencing holds 
great promise for schools and stu- 


dents, however, it requires bandwidth 
and high performance computers. 
Capacity information will tell you 
whether your systems are capable of 
efficient videoconferencing. 

Issue Tracking. Issue tracking is hav- 
ing teachers, staff, and administrators 
log their issues in a program (prefer- 
ably Web-based), also known as Help 
Desk software. I recommend Ilients 
SysAid Help Desk software. This in- 
formation can then be queried by the 
technical support staff and responded 
to in a timely manner. Feedback 
can also be returned to users in a 
timely manner. As time progresses, 
this information can be used to see 
trends, which school buildings or 
technologies are consuming the most 
resources, what the top issues are, and 
the need and effectiveness of teacher 
training. 

Logging. Logging records errors and 
significant events from your schools 
technology. Kiwi also offers a scalable, 
inexpensive tool called Kiwi Syslog 
Daemon. This is one of the most 
powerful tools because it can collect 
a great deal of technical information. 

It can determine when the Internet is 
not accessible and generate an alarm 
to the technology staff. It will note 
when objectionable Web sites were 
accessed and by whom. It can also 
help with troubleshooting. Logging 
can also be the root for the informa- 
tion showing usage patterns of certain 
technologies. This is a perfect example 
of information that may seem too 
complex and obscure; therefore, it s 
often not collected and considered. 
Don’t fall into this trap. This data, 
especially, can provide answers to im- 
portant educational questions. Even 
if all the filters (questions) aren’t yet 
crafted, begin to collect the informa- 
tion. It most likely will be useful later. 

Availability and Performance. Avail- 
ability and performance tools collect 
information about what is working 
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Decisioin®, are limited by the information 
used to maM© them. All possible information 
should; be Q.onsidered. 


and how long it takes to work. One 
of the best tools is HostMonitor. The 
benefit of having this information is 
its ability to provide real-time status 
of your schools systems. This tool 
can produce a Web page that lets 
teachers, staff, and administrators 
know the e-mail server is down in just 
those words. Having this information 
at their fingertips, school stakeholders 
don t have to waste time figuring out 
that it isn t working, making a call, or 
entering a ticket in an issue tracking 
system. They will know and can plan 
accordingly. 

Resource Management Resource 
management is the information that 
doesn’t fit into any other category 
but is vital for decision making none- 
theless. This is information such as 
network and infrastructure diagrams. 
This is also the area where databases 
can be created and used to find out 
what technology is planning on being 
used. If a current electronic database 
of lesson plans is already created, it 
can be integrated into this area. As 
school networks become more com- 
plex, documentation is absolutely 
vital. Another vital area of informa- 
tion is asset management. Ilient offers 
free and for purchase Web-based 
asset management tools. This includes 
information about where comput- 
ers are located, their model, operat- 
ing system and service release, serial 
number, warranty information, and 
IP addresses (if fixed). For efficiency 
and accuracy of decision making, this 
information should be at school stake- 
holders fingertips. 

Creating Filters 

Determining what filters need to be 
created can be challenging. All of the 


raw data from all the categories must 
be filtered and then made meaningful. 
Remember that the filters are really 
just questions. The best approach is to 
ask what questions each stakeholder 
may have about technology. This can 
be done by directly asking them or 
coming up with your own list. This 
is the chicken and egg. I find that, in 
many cases, until I start with the ques- 
tions that can be answered, school 
stakeholders don’t know where to 
begin. Providing some type of base of 
questions can really help to show the 
value of this information. 

Although I believe there are many 
questions, even complex ones, that 
can be answered, I recommend begin- 
ning with simple questions, such as 
“is my district’s capacity information 
being collected?” or “do I have enough 
capacity to store student portfolios?” 

You may notice some overlap of 
questions. That is normal, as differ- 
ent stakeholders need to know the 
same information but for different 
reasons. Also, this is a process not an 
end point. As with any other process, 
start off small. Build out as time and 
resources and in this case, questions, 
permit. 

Meaningful Reports 

The third component is making 
filtered data meaningful and un- 
derstandable. Answers to questions 
should be in wording that stakehold- 
ers can easily understand. For ex- 
ample, saying the “Internet is down” 
is understandable. We shouldn’t say, 
“The core router is experiencing CRC 
errors on its ATM interface due to po- 
licing issues.” 

I would also suggest that all tech- 
nology activities relate directly to 
curriculum and instruction. The in- 


formation should show the effect on 
curriculum and instruction. What 
curricular goals and objectives are di- 
rectly affected by the Internet outage? 
What curricular goals and objectives 
are directly affected if we don’t have 
enough Internet capacity? What cur- 
riculum objectives are directly affected 
if the Internet is slow? 

What is affected if we don’t have 
enough IP addresses for those ad- 
ditional wireless laptop carts? All 
of these questions should show the 
curricular effects on most school 
stakeholders, leaving out the technical 
details. Technical details are for the 
technologists. 

Showing curricular effects makes 
the technical information much more 
meaningful and understandable. I also 
find it interesting that once techni- 
cal data is put in their context, school 
stakeholders really begin to take note. 

Presenting Data 

The next question is how to present 
this information to school stakehold- 
ers. I believe there are three primary 
means: Web-based reports, dash- 
boards (which are currently in de- 
velopment), and through traditional 
communication such as e-mail or 
newsletters. PRTG, Ilient SysAid, and 
HostMonitor all produce Web-based 
reports. Dashboards could provide 
much valuable information in an easy 
to read graphical or textual format. 

The reports can be used in e-mail and 
newsletter publications that are dis- 
seminated to school stakeholders. 

Integration into DDDM/SIF Standards 

The phrase data-driven decision mak- 
ing has been popularized through the 
No Child Left Behind Act. Although 
we all use data to make decisions, this 
initiative calls on schools to consider 
multiple sources of data to make deci- 
sions at both district and classroom 
levels. Because multiple informa- 
tion sources must be considered, the 
Schools Interoperability Framework 
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Association has created a standard 
called School Interoperability Frame- 
work (SIF). The standard holds a great 
deal of promise to ensure that all that 
data can be easily integrated and thus 
be made meaningful. 

Keep two issues in mind when con- 
sidering SIF. It doesn’t consider edu- 
cational technology information as a 
valid source and none of the applica- 
tions mentioned here are SIF com- 
pliant. However, I believe it s only a 
matter of time before this data is con- 
sidered valuable and applications will 
thus become compliant. But for now, 
don’t let SIF compliance get in the way 
of being able to make decisions based 
on all of the facts. 

A Role in Educational Standards 

Ed Tech data can ensure that stan- 
dards, whether local, state, national, or 
organizational, are achieved. Take the 
National Education Technology Plan 
for example. The fifth objective in the 
plan is to “Encourage Broadband Ac- 
cess.” The following are excerpts from 
the text: 

Most public schools, colleges, and 
universities now have access to 
high-speed, high-capacity broad- 
band communications. However, 
broadband access 24 hours a day, 
seven days a week, 365 days a year 
could help teachers and students 
to realize the full potential of 
this technology and broadband 
technology needs to be properly 
maintained. 

Thoroughly evaluate existing 
technology infrastructure and ac- 
cess to broadband to determine 
current capacities and explore 
ways to ensure its reliability. 
Encourage that broadband is 
available all the way to the end- 
user for data management, online 
and technology-based assess- 
ments, e-learning, and accessing 
high-quality digital content. 
Encourage the availability of 


adequate technical support to 
manage and maintain computer 
networks, maximize educational 
uptime, and plan for future needs. 

Ed Tech data can help ensure 
broadband technology is properly 
maintained, is reliable, managed and 
maintained, and used to maximize 
educational uptime. 

Other standards are no exception. 
Ed Tech data can help ensure they are 
met from a technical perspective, no- 
tify those involved when they can’t be 
met, and show their effects. In making 
decisions about how to achieve stan- 
dards, consider this data. 

School Technology Plans 

Looking farther down the road, 
school technology plans will take 
on a new look and role using Ed 
Tech data. School technology plans 
can be much more dynamic and 
fluid when the data used to measure 
them are electronic and retrievable 
real-time through filtering. If a goal 
is to have 30% more use of video- 
conferencing in the district, this 
data can not only determine whether 
videoconferencing is possible, but 
also report whether the goal of a 
30% increase is achieved. If it’s not 
achieved, it can help to shed light 
for decision making through the 
issue tracking and other logging 
means. 

Putting It in Perspective 

A great deal can be learned about 
the DDDM process by studying the 
business intelligence (BI) process 
embraced in the corporate world. I 
believe as we begin our DDDM jour- 
neys we should consider how BI is 
being implemented and used. BI al- 
lows corporate stakeholders to make 
decisions based on real-time data that 
has passed through a set of filters. 
These filters include questions such as: 
How are sales in each region? What 
inventory do I have remaining? What 


are my bonus obligations? This infor- 
mation is real-time and meaningful to 
the person viewing it. The trend now 
in many BI reports is to use a dash- 
board containing charts and graphs 
to represent the data. I imagine once 
these processes become implemented, 
educators will realize the power of 
meaningful data in various decision- 
making processes. 

Conclusion 

Decisions are limited by the informa- 
tion used to make them. All possible 
information should be considered. 
Not doing so can have a direct effect 
on student learning. Although the 
data may seem complex and over- 
whelming, take the information bull 
by the horns. Start simply and start 
small using questions as your guide. 
Once underway, you will look back 
wondering how you ever worked 
without it — leave no data behind. Let 
the filtering begin. 
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Resources 

HostMonitor: http://www.ks-soft.net 
Ilient: http://www.ilient.com 
Kiwi Syslog Daemon: http://www.kiwisyslog. 
com 

National Education Technology Plan: http:// 
www.nationaledtechplan.org 
PRTG: http/Zwww.paessler.com 
Schools Interoperability Framework 
Association: http://www.sifinfo.org 
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